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Preface 



The Personal Responsibility and Work Opportunity Reconciliation Act of 1996 dramati- 
cally increased states’ flexibility in designing income support, employment, and social 
service programs for welfare recipients. As a result, many states are experimenting with 
new program approaches and with contracting out service provision. Because of these 
developments, counties and nongovernment service providers are increasingly called 
upon to estimate the cost of existing and yet-to-be-implemented programs. 

This guide provides a systematic approach to costing out employment and training 
programs for low-income people. It is geared toward practitioners in both government 
agencies and community-based organizations who are asked to assess the cost of pro- 
grams or program components that are currently running or are still in the planning 
stages. The guide helps states, localities, and service providers to calculate and present 
cost estimates through a step-by-step approach. The steps can be directly applied by 
using the spreadsheets provided on the accompanying disk. 

This guide is the latest publication in the Connections to Work series, a project con- 
ducted by MDRC with support from The Rockefeller Foundation and the Charles 
Stewart Mott Foundation. The authors are David H. Greenberg, Professor of Economics 
at the University of Maryland, Baltimore County, and Ute Appenzeller of MDRC. By 
making this knowledge accessible to program providers and planners at a time of high 
demand for programs that move people from welfare into jobs, and by illustrating the 
approach with cost figures from real programs, the authors aim to provide a highly prac- 
tical guide that can be used as an easy-to-access reference book. 



Judith M. Gueron 
President 
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Chapter 1 



Who This Guide Is Foi^ 
and How If Can Be Used 



This guide presents step-by-step instructions for conducting cost analyses of both 
ongoing and proposed social programs for the poor. It focuses on one particular type 
of program: employment and training (E&T) programs that are intended to improve 
the performance of low-income people in the labor market and reduce their reliance on 
welfare payments and unemployment compensation. But it also recognizes that these 
programs can serve volunteers or be part of a welfare system that requires those receiv- 
ing aid to participate in employment-oriented services. It is aimed at planners and 
practitioners in government agencies that fund, operate, and contract out such programs 
and in community-based or other nonprofit organizations that deliver the services. 



Cost Analysis Step by Step 
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1.1 Introduction 







Employment and training programs attempt to accomplish their objectives by providing 
such services as job search assistance, training, education, subsidized employment in the 
private sector, and community service jobs in the public sector. Long viewed as an 
important tool for increasing employment, such programs have been an integral part of 
welfare reform efforts since the 1960s. Starting in the mid 1970s, some states began to 
mandate participation in these services as a condition of aid for many categories of 
recipients. With the passage of major federal welfare legislation in 1996 — the Personal 
Responsibility and Work Opportunity Reconciliation Act — the receipt of aid is linked 
closely with participation in employment-oriented services, and welfare agencies are 
now putting even greater emphasis on using E&T programs — which in a welfare set- 
ting are often called “welfare-to-work programs” — to help recipients achieve economic 
independence. By funding welfare through federal block grants to the states (Temporary 
Assistance for Needy Families, or TANF), the 1996 law gives states great freedom in 
designing E&T programs. Over time, this freedom is likely to result in important 
changes in the program models used to serve welfare recipients. These changes will have 
significant cost implications for states and localities, and it is important for program 
providers and planners to understand these cost implications as states plan expansions 
or modifications of their welfare-to-work initiatives. 

This guide provides a systematic approach for “costing out” an E&T program. Cost 
estimates can be obtained either for the program as a whole or for specific program 
activities and support services. These estimates can be used for planning new E&T pro- 
grams and for assessing and modifying existing programs. The approach developed in 
the guide can also be helpful in formulating Requests for Proposals and in responding to 
them. Although the scope of the guide is limited to E&T programs, the general frame- 
work can be readily adopted to obtaining cost estimates for other social service pro- 
grams. 

The approach presented here has proven useful to practitioners and researchers 
in the field of social service programs. However, to the best of our knowledge, nothing 
similar to this guide exists. This guide provides practical guidelines for: 

■ measuring program costs; 

■ presenting cost information in the most useful manner possible; 

■ dealing with issues and problems encountered in measuring costs. 

Section 1 .2 describes the various ways in which cost analyses of E&T programs are 
used. Section 1.3 provides recommendations on how the guide can best be used for con- 
ducting and interpreting cost analyses, and presents an overview of how the remainder 
of the guide is organized. 
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Potential Uses of Cost Analyses 

Cost analyses of social service programs can be usefully conducted at two different 
points in time: prior to implementing a new program and after a program is already 
running (even if the program has been in operation for a number of years). As discussed 
next, each type of analysis can serve multiple purposes, although they differ in impor- 
tant respects. 

Cost Analyses of Programs Prior to Their Implementation 

Before an agency implements any new program, it must have some idea of the 
overall program cost in order to have sufficient funds allotted to operate the program. 
Moreover, it needs information on the components of those costs to determine how 
many new personnel will need to be hired, the cost of new equipment that will have to 
be purchased, the rental cost of additional office space that may be required, and so 
forth. Sometimes the agency sponsoring a new E&T program plans to contract out part 
of the operation of the program to other institutions, and cost information is needed 
by both parties to negotiate a contract. Thus, programs need to be costed out before 
they are implemented. 

The usefulness of conducting cost analyses for programs that are still at the plan- 
ning stage goes well beyond budgeting and resource planning. Such analyses are also 
useful in making decisions about whether a proposed program should be implemented 
in the first place. If the potential costs of the program are deemed too high, then the 
program may not be adopted. Even if a decision is made to go ahead with the program, 
several possible variants of it may exist and the costs of these competing program 
variants are likely to differ. In such cases, their relative cost is likely to be an important 
consideration in deciding among them. 

As important as costs are, however, they should never be the only factor in making 
decisions about E&T programs. The extent to which program goals are met — that is, 
the extent to which the program engenders benefits such as increases in earnings or 
decreases in dependency on welfare payments — must also be taken into account. For 
example, a higher-cost program might have advantages over a lower-cost program if it 
also results in larger benefits. 

Cost Analyses of Ongoing Programs 

Cost analyses of social programs are conducted much more easily once a program 
has been implemented. Cost analyses of not-yet-implemented programs must typically 
be based on projections or informed guesses about such issues as the number of people 
who will actually receive services and the length of time participants will- receive those 
services. Hence, they are inherently subject to considerably more uncertainty than 
analyses of ongoing programs, for which much information is already available. 




±0 



Cost Analysis Step by Step 



4 



, *V 
f 




f 




n-' • 



f- 




1 ; 
j' 



Cost analyses of ongoing programs can serve a number of purposes, although, as 
will be seen later, the exact nature of the analysis will vary depending on the particular 
purpose it is intended to serve. The first type of use is to monitor an ongoing program, 
including both program activities that are performed in-house by the agency sponsoring 
the E&T program and those that have been contracted out. Do the costs of each pro- 
gram component appear reasonable? Are cost expectations being met? Was the pre- 
implementation cost analysis correct? If not, why not? Answering these questions is part 
of a learning process. The answers are also essential in determining whether the condi- 
tions in performance-based contracts that contain cost criteria are being met. In addi- 
tion, cost analyses can be used to make various adjustments. For example, if the pro- 
gram is much more expensive than initially anticipated, it might be necessary to scale 
back the services provided or accept fewer participants. If it is less expensive, somewhat 
richer services might be provided or eligibility criteria might be relaxed. 

Cost analyses can also be used to conduct evaluations of ongoing programs — that 
is, techniques used to assess whether existing programs are working and whether they 
can be improved. Program evaluations can help answer the following sorts of questions: 
Is an existing program working? Can it be improved? Should it be terminated? How do 
different programs compare? Should a program that is being operated in one place be 
considered for adoption in other locations? 

An analysis that focuses solely on costs, such as the one described in this guide, pro- 
vides only some of the information needed to respond fully to such questions — but it is 
a necessary first step in evaluating a program. A more formal analysis that compares 
program costs with program benefits, which is the most valuable way to determine a 
program’s overall worth, goes beyond the scope of this guide. Readers who would like 
more information on conducting cost-benefit analyses of E&T programs might want to 
consult chapter 9 in Cost- Benefit Analysis: Concepts and Practice , by Anthony E. 
Boardman et al. (Upper Saddle River, NJ: Prentice-Hall, 1996). 



How to Use This Guide 



The guide was conceived as a template for a very comprehensive cost analysis but, 
because resource and time constraints may make such a comprehensive analysis infeasi- 
ble in practice, shortcuts are suggested throughout. Nonetheless, readers should be 
aware that a more extensive analysis relies on the full template presented here, and that if 
compromises must be made, it is very important that both those conducting the analysis 
and those using the findings understand how their results will vary from those that 
would emerge from a more extensive analysis. They should be aware, for example, of 
costs that are left out or are imperfectly estimated. To illustrate how cost analyses of E&T 
programs can be conducted and presented, we often draw on findings from cost analy- 
ses of real programs that have been conducted by the Manpower Demonstration 
Research Corporation (MDRC). 
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Chapter 1: Who This Guide Is For and How It Can Be Used 



The sections of this guide are highly interdependent, and concepts developed in the 
early chapters are often used later on, so it is recommended that you read the chapters 
consecutively. To assist readers who are actually conducting a cost analysis (as opposed 
to using findings from cost analyses), each chapter begins with an overview of its con- 
tents. In addition, text boxes are used throughout the guide to supplement the narrative. 
Moreover, examples are frequently used to illustrate the concepts. Examples are indicat- 
ed by the symbol (Q) in the margin. The guide also includes a 3.5" floppy disk with 
Excel spreadsheets that are modeled after the step-by-step approaches developed in the 
text. You can use these spreadsheets for developing your own cost estimates. Whenever a 
reference to the disk is made, the symbol (^[ appears in the margin. 

Table 1.1 (page 6) will help you determine which sections are most useful to you. 
The following is a brief overview of how the remainder of this guide is organized: 

Chapter 2 focuses on conceptual issues, particularly issues concerning how costs should 
be defined and what costs should be included as part of a cost analysis. It will be seen 
that deciding which costs to include in a cost analysis depends on the purposes to be 
served by the analysis. 

Chapter 3 provides step-by-step instructions for conducting a cost analysis of an ongo- 
ing E&T program, and discusses the data needed to do this. 

Chapter 4 presents detailed findings from a previous cost analysis, one conducted by 
MDRC of an E&T program for welfare recipients. The chapter illustrates how the meth- 
ods described in chapter 3 can be applied in practice and how to display cost informa- 
tion from ongoing E&T programs. Considerable emphasis is given to the factors that 
cause costs to vary among programs. 

Chapter 5 describes the steps required to conduct cost analyses of not-yet-implemented 
programs. Particular emphasis is given to how findings from cost analyses of ongoing 
E&T programs can be used in costing out not-yet-implemented programs. 

Chapter 6 describes some additional ways in which the cost analyses described in the 
preceding chapters can be used. 

Appendix A summarizes the program features and main evaluation findings of pro- 
grams discussed in this guide. 

Appendices B-F provide various values that were used in MDRC cost analyses of ongo- 
ing programs. As described in chapter 5, these values can be used to conduct cost analy- 
ses of not-yet-implemented programs. 

The Glossary lists and defines many of the terms used in this guide. It can be found at 
the end of this publication. 1 

The pocket on the inside back cover contains a disk with Excel spreadsheets. These files 
can be used as worksheets for adopting the steps described in chapters 3 and 5 in cost- 
ing out your own program. 
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Table 1.1 



. ; , - WHICH SECTIONS OF THE GUIDE ARE FOR YOU?' < v - r I 


If you are . . . 


The most useful sections for you are . . . 


A policy or cost analyst 
at a government agency 


Chapters 1-6. 

(SKIP sections 5. 3. 5. a and b, which present details about 
computing unit costs.) 

Files on disk. 


A program planner 


Sections 2.1 and 2.2. 

Chapter 4 for an illustration of the implications of 
program design for costs. 

Sections 5.2 and 6.1 for discussion and illustrations of 
sensitivity analyses. 

File on-going on disk. 


A community-based 
organization that is thinking 
about expanding its current 
E&T operations 


Chapter 3 and section 6.1 for help in costing out current 
operations and proposed changes, and in conducting 
sensitivity analyses to determine how programmatic changes 
will affect costs. 

File on_going on disk. 


A community-based 
organization that has not 
previously been involved 
in an E&T program but is 
planning to be 


Chapter 2 for major concepts that should be considered 
in preparing cost estimates. 

Chapter 5, which includes a worksheet for predicting costs. 
File new_prog on disk. 

Chapter 6 for help in conducting sensitivity analyses and 
developing a program budget. 


A government agency that is 
preparing requests for bids on 
E&T components and wants 
bidders to use a uniform frame- 
work for providing cost estimates 


Sections 2.1 and 2.2. 

Chapters 4-6, which include a uniform framework for 
providing cost estimates. 

File new _prog on disk. 


An agency or organization 
that is bidding to operate all 
or part of an E&T program 


Sections 2.1 and 2.2. 

Chapters 4-6 for help in preparing cost estimates for your bid. 
File new _prog on disk. 


An internal auditor or program 
administrator concerned about 
the efficiency and performance of 
an existing E&T program 


Chapters 3 and 4 for procedures for obtaining cost 
information that can be used to monitor ongoing programs. 

Section 6.1. 

File on-going on disk. 


An individual responsible for 
overseeing a program (e.g., a 
comptroller or a staff member of 
a legislative committee) 


Chapter 2 for conceptual issues in considering costs. 

Chapters 4 and 6 for information that can be obtained from 
cost analyses of E&T programs. 

Sections 3.3 and 5.1 for help in understanding the steps 
required for conducting analyses of E&T programs. 

(SKIP the detailed explanations of how to complete each step.) 
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| Th> s chapter starts by considering the issue of perspective — that is, who will be affect- 

ed, and how, by various program costs? To appropriately measure costs, this question 
must first be answered. The costs to include in a cost analysis depend on the perspective 
that is most important — that of trainees or that of the agencies and organizations run- 
| n * n 8 the program. If the latter, a further decision must be made about whether to 

j include costs accruing to all the agencies and organizations in the program, or just a 

! subset. 

| The chapter also relies on some standard definitions used by accountants and econ- 

■' omists to explore various decisions that must be made in measuring costs. In conduct- 

i * n g cost analyses, these decisions are often made implicitly, without considering how 

j the y wiU affect findings from the analysis — but, as will be seen, the findings are some- 

j times quite sensitive to such decisions. One objective of this chapter is to clarify the cir- 

f. cumstances under which a particular decision is most appropriate. 

The final section of the chapter describes the role of discounting, adjusting for infla- 
- tion, and depreciation in cost analysis. This section will mainly be of interest to readers 

| who are conducting cost analyses, rather than to readers using findings from them. 
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2.1 The Issue of Perspective 

A key issue in conducting cost analyses concerns the groups, agencies, and organizations 
to which costs accrue. In brief: Whose costs should be counted? As discussed below, 
there are several dimensions to this issue. 

2.1.1 Alternative Perspectives 

As previously suggested, E&T costs, as well as benefits, can accrue to several groups 
and institutions, including the various government agencies and nongovernmental 
organizations (NGOs) that operate program activities or provide program services, and 
to participants themselves. It is also possible to view costs (and benefits) from the per- 
spective of society as a whole, where “society” is defined to include all the groups and 
institutions just mentioned and “everyone else” — that is, all other groups, institutions, 
and individuals in society apart from program participants. The differences between the 
perspectives of various groups and institutions are considerable. Similarly, there are 
major differences between the broad social perspective and each of the narrow perspec- 
tives. 1 Some costs — such as day care costs that are not reimbursed by the government 
— accrue only to participants, and are counted from the participant’s perspective as well 
as from a societal perspective, but not from a government perspective. Other E&T pro- 
gram effects — such as stipends paid to participants — are a cost to the government, 
but a benefit to the participants themselves, so from a societal perspective, but not a 
government perspective, they cancel out. Still other E&T effects — such as reductions in 
welfare payments — are benefits to the government and a cost to participants, so they, 
too, cancel out from a societal perspective. 

These various perspectives are summarized in Table 2.1. The table also depicts a 
slightly more complex example in which a nongovernmental organization provides 



Table 2.1 
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Effect 


Government 


NGO 


Participant 


Society 


Nonreimbursed day care costs 


n/a 


n/a 


Cost 


Cost 


Stipends paid to participants 


Cost 


n/a 


Benefit 


Neutral 


Reductions in welfare payments 


Benefit 


n/a 


Cost 


Neutral 


Provision of vocational training 


n/a 


Cost 


n/a 


Cost 


Payment to vocational training 
provider 


Cost 


Benefit 


n/a ' 


Neutral 



NOTE: n/a means not applicable. 



1. Cost-benefit analysis often refers to a taxpayer perspective, which is almost identical to a government budget 
perspective. For more details, see James Riccio, Daniel Friedlander, and Stephen Freedman, GAIN: Benefits, Costs, 
and Three-Year Impacts of a Welfare-to-Work Program (New York: MDRC, 1994). 
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vocational training for E&T participants and is paid by the government for providing 
this service. The payment made by the government is listed separately from the provi- 
sion of training because, in practice, the amount paid by the government could cover 
either more or less than the costs incurred by a vocational training provider, depending 
on the specific contractual arrangement. 

Choosing Among Perspectives 

A key decision in a cost analysis is the choice among the different perspectives 
described above. Consider first the choice between the societal perspective and the more 
narrow perspectives of the agencies and organizations that operate E&T programs. In 
other words, should the participant’s perspective be ignored? The answer to this ques- 
tion turns largely on how the cost analysis will be used. 

For many purposes, cost analyses need consider only costs that are incurred by the 
agencies and organizations involved in the operation of an E&T program. Information 
on such costs, for example, can be used in costing out proposed E&T programs for bud- 
geting purposes or for monitoring ongoing programs. For other uses — such as deci- 
sions about whether to adopt a new program or expand or scale down an existing pro- 
gram it would be ideal to conduct a formal cost-benefit analysis. Such an analysis 
would include the participant s perspective as well as the perspectives of government 
agencies and NGOs, and would involve measuring both benefits and costs. However, 
such an analysis requires an investment of considerable time and resources. Indeed, 
firms that specialize in cost-benefit analyses of E&T programs can best conduct such 
evaluations. While less than ideal, a cost analysis that ignores benefits and the partici- 
pant’s perspective may be all that is feasible and is still very helpful. 

A government agency with overall responsibility for operating an E&T program, 
referred to here as the “program agency,” obviously incurs costs as a result. However, 
other government agencies and institutions (for example, community colleges) and 
NGOs may also incur costs. For some purposes, such as resource planning and monitor- 
ing, each agency or organization may be interested only in those costs that it incurs. For 
these purposes, even the program agency will mainly be interested in its own costs. A 
nongovernmental organization that is bidding to provide a particular E&T service, for 
instance, will obviously be concerned with predicting its own costs, but not those that 
occur elsewhere. When agencies and institutions want to focus only on their own costs, 
the cost analysis is considerably simplified because many costs can be ignored. 

Moreover, it is typically easier for an agency or organization to obtain information on its 
own costs than on costs accruing elsewhere. 

For other purposes, however, a program agency should consider all costs, regardless 
of where they occur. This would be true, for example, of cost analyses thiat are being 
used to decide which of several competing programs to adopt or whether to expand or 
cut back on an ongoing program. In such cases, however, it is still often useful to report 
costs separately for each agency and organization that incurs costs. In conducting a 
comprehensive cost analysis in which costs incurred by the program agency, as well as 
by other agencies and organizations, are included, it is important not to double-count. 
For example, the cost incurred by a vocational training provider and the program 
agency s payment to the vocational training provider should not be summed. 
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In the operation of E&T programs, costs may be incurred at each level of govern- 
ment — federal, state, and, local — with the precise allocation among levels somewhat 
arbitrarily determined by various pieces of legislation and negotiated agreements. Each 
level of government will, of course, be especially concerned with the costs that it incurs. 
Thus, in a comprehensive cost analysis of an E&T program that attempts to incorporate 
all costs, it is useful to report costs separately for each government level. 



2.2 Costs 

2.2.1 Definition of Costs 

As previously discussed, this guide is aimed at persons within the agencies and 
organizations funding and operating E&T programs and providing services used by 
E&T programs. Consequently, the remainder of the guide focuses on costs accruing to 
these agencies and organizations and ignores the perspective of participants and, hence, 
that of society as a whole. 

Therefore, we define the costs of an E&T program as expenditures on the resources 
required to run the program. These expenditures result directly from purchases that are 
necessary to provide services under the program, including expenditures on staff 
salaries and fringe benefits; purchases of goods, services, office space, and equipment; 
vendor payments; and day care and transportation. They also include special payments 
that are an integral part of operating the program, such as subsidies paid to employers 
who hire program participants and stipends or allowances paid to the program partici- 
pants themselves. 

Under this definition, costs do not include program-engendered changes in transfer 
payments — for example, Temporary Assistance for Needy Families (TANF), Medicaid, 
and unemployment compensation — even if these payments increase unintentionally, or 
changes in the administrative costs of running transfer programs. Similarly, effects on 
the earnings and tax payments of program participants are excluded, even if participant 
earnings and tax payments decline. Costs borne by program participants are also not 
included under this definition — for example, work-related expenses such as child care 
and transportation costs that result because the program increases employment or 
hours worked. None of these items represents expenditures that are directly incurred by 
agencies and organizations in running E&T programs. 

For most purposes, the value of donated equipment or time would also not be count- 
ed as costs because such donations do not result in expenditures by the agencies and 
organizations operating E&T programs. However, if the program is being considered for 
adoption elsewhere, it is important that the agencies and organizations qonsidering it be 
provided information on the market value of donated time and equipment because they 
may not receive these goods as donations, but have to purchase them instead. 

As should be apparent, a cost analysis of an E&T program provides only a very par- 
tial look at program effects. For that reason, the interpretation of a cost analysis should 
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account for what is left out as well as what is included. It would make little sense to 
attempt to minimize expenditures on an E&T program without also considering the 
implications for benefits from the program — for example, whether the effects of the 
E&T program on earnings or on the receipt of welfare payments will diminish with the 
reduction in E&T costs. 

Gross Costs Versus Net Costs 

Costs were previously defined as expenditures on the resources required for operat- 
ing an E&T program. These expenditures can be measured in either gross terms or net 
terms. Gross costs are relatively straightforward to understand and measure. They are 
simply direct outlays required to operate a program. Gross costs are usually sufficient for 
use in monitoring an ongoing E&T program or in administering performance contracts. 
Information on gross costs is also useful in planning for a new program. It is also usually 
appropriate to use gross costs in selecting one program model over another. In addition, 
if another site is considering adopting the program, information on the programs gross 
costs is useful because it allows the site to compare the gross costs of its own current 
program with a possible alternative. 

Net costs are more complex than gross costs and considerably more difficult to com- 
pute. Net costs are the change in costs that result from a specific decision — for example, 
a decision to adopt a new program, to expand or scale down an existing program, or to 
modify some component of an existing program (for example, to increase class size). 
Hence, net costs are more appropriately used in making decisions of this sort than are 
gross costs. Net costs, like gross costs, are also useful for budget planning purposes. 
Finally, net, rather than gross, costs should always be used to conduct formal cost-bene- 
fit evaluations of E&T programs. Thus, information on net costs is useful to decision- 
makers at both government agencies and private-sector service providers. 

Start-Up Costs 

The costs required to initiate a new E&T program — expenditures on curriculum 
development, writing regulations, developing computer software, and so forth — are 
often called start-up or development costs. Start-up costs also include costs that result 
from learning how to operate a new program. For example, costs could fall over time 
because of various improvements that are made in program efficiency. 

There is an important distinction in the treatment of start-up costs when estimating 
the net costs of a not-yet-implemented E&T program versus an ongoing program. If an 
E&T program has not yet been implemented, then whether start-up costs are actually 
incurred depends on whether or not the program is adopted; they are part of the cost of 
adopting the program and should be included in estimating the prograrqs net costs. 
However, in the case of an ongoing program, start-up costs have already been incurred 
and no decision that is made with respect to the ongoing program, including terminat- 
ing it, can affect these costs: they are fixed, or “sunk.” Thus, start-up costs should not be 
included as part of the net costs of ongoing programs. 
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WHAT IS THE DIFFERENCE BETWEEN NET COSTS AND GROSS COSTS? 



To understand how net costs differ from gross costs and why they are more appropriately 
used for certain purposes, consider a decision on whether to replace an existing E&T program 
with a new one. If the proposed new program is adopted, then expenditures on the existing 
program will no longer be incurred. To compute the change in costs resulting from adopting 
the new program (that is, its net costs), the gross cost of the existing program must be sub- 
tracted from the gross cost of the proposed program. This may not be the end of the process, 
however. 




For example, the agency that would run the proposed program might already have furniture 
and classroom space that it is not using in running the current program, but would use for the 
new program. Unless this furniture and classroom space will be used for some non-E&T pur- 
pose, but cannot serve this purpose once the new E&T program is implemented, using the 
existing furniture and equipment in operating the E&T program imposes no additional costs. 
Thus, in computing the net cost of the new program, these elements are appropriately subtract- 
ed from the programs gross cost. 

Similarly, in decisions concerning whether to go ahead and adopt a proposed program, the 
cost issue typically concerns how much more the new program will cost than an existing one, 
not its absolute (gross) cost. An E&T program that results in little or no additional costs is not 
very expensive, even if its gross costs are large. In budgetary planning for the program, the 
important issue is not the total amount of staff and equipment required, but the additional staff 
that must be hired and the additional equipment that must be purchased. Likewise, if a decision 
is being made about whether to expand or contract an ongoing program, the relevant issue is 
the additional costs or savings that would result — in other words, the change in net costs. 



To help ensure that start-up costs are excluded, cost analyses of ongoing programs 
are sometimes delayed until after the program has reached a steady state — that is, until 
after the program has reached the point at which its costs over time are expected to be 
relatively stable. 

2.2.4 Average Costs Versus Marginal Costs 

The average cost of an E&T program is simply the cost per participant. Marginal 
costs are the additional costs that result from serving an additional participant or the 
cost savings that result from serving one less participant. 

In conducting cost analyses of E&T programs, marginal costs are often very difficult 
to measure. Thus, average costs are typically used instead. Although thjs decision is 
appropriate for some purposes, such as resource planning for a new program or moni- 
toring an existing program, it is not appropriate in decisions concerning expanding or 
contracting an ongoing program. For that purpose, marginal costs should ideally be 
used instead. However, in practice, as will become evident in chapters 3 and 5, it is not 
always easy to estimate marginal costs, and average costs are often used as the best avail- 
able approximation. 
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EXAMPLES OF AVERAGE VERSUS MARGINAL COSTS 

Marginal cost can differ considerably from average cost. Consider the following 

examples: 

• Certain pieces of equipment and certain supervisory activities may be required 
regardless of whether an E&T program is large or small. For example, whether an 
E&T program is in every county in a state or in only a few counties may have rela- 
tively little effect on the number of persons involved in administering it at the state 
level. If that is the case, as the number of program participants expands, program 
costs will not grow as quickly. Consequently, marginal costs will be less than average 
costs. 

• If the size of an E&T class is expanded, it may not be necessary to increase the 
space used or the number of teachers. In that case, the marginal costs will again be 
less than the average costs. 

• If it is necessary to make major new purchases or to rent new facilities in order to 
expand, marginal costs may exceed average costs. This may be especially impor- 
tant in the case of small organizations that begin bidding to provide E&T services. 

• In expanding an E&T program, the new participants may differ in important 
respects from those currently enrolled. For example, they may have fewer or 
greater barriers to employment and, hence, require less expensive or more 
expensive services. In the first instance, the marginal costs will be less than the 
average costs; in the latter case, they will be greater. 



L 2.2.5 Joint Costs 

Some resources are used for several purposes at once. For example, the same com- 
ly puter terminals at a welfare agency might be used to administer welfare payments and to 

t tr^ck clients enrolled in E&T programs. When resources are used for multiple purposes, 

their costs are sometimes called joint costs. 

k. In a cost analysis, resources that are used jointly raise the difficult issues of what 

proportion of the total cost of the resource to assign to the program being analyzed. Any 
! treatment of joint costs is likely to be somewhat arbitrary. One possibility, and the one 

m ost commonly used in practice, is to allocate cost on the basis of the proportion of the 
resource used for each purpose. 




For example, if one-fourth of the time spent using computer terminals involves the E&T 
program being analyzed, then 25 percent of the total cost of the terminals would be 
assigned to the program in question. In contrast, 100 percent of the cost of terminals 
used exclusively to track E&T participants would be allocated to the prog'ram. 

A better approach would be to attempt to determine whether the resource would 
have been purchased at all in the absence of the program. If the answer is yes, then the 
program engenders no additional costs and none should be allocated to the program. If, 
however, the resource is purchased only as a result of the program, then its total cost 
should be allocated to the program, even if it is also used for other purposes. 
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2.2.6 Regular Versus Special Costs 

Regular costs occur in the normal operation of an E&T program; they are essential 
to running the program. Special costs, as the name implies, are not essential to the opera- 
tion of a program. A good example is provided by the cost of conducting cost analyses 
themselves. Cost analyses conducted in connection with implementing a new E&T pro- 
gram or to monitor an existing program would usually be viewed as regular costs. It is 
difficult to imagine implementing an E&T program without first costing out the pro- 
gram, and analyzing cost data for monitoring purposes is a routine part of operating an 
E&T program. Conducting a cost analysis as part of a cost-benefit evaluation of an 
ongoing E&T program, in contrast, is a special cost. Although useful, it is not a necessary 
component of operating the program. While regular costs should be counted in con- 
ducting a cost analysis, special costs usually should not be. 



2.3 The Time Dimension 

Cost analyses of not-yet-implemented E&T programs typically attempt to predict the 
annual costs that will result from adopting the program. Annual cost figures are espe- 
cially appropriate for budgetary and planning purposes. However, as discussed in some 
detail in chapter 5, annual costs may vary considerably from one year to the next, and it 
is important that this variation be taken into account. 

As indicated in chapter 3, cost analyses of ongoing E&T programs, in contrast to 
those of not-yet-implemented programs, usually examine the costs incurred by specific 
groups (or cohorts) of persons who enrolled in the program during a fairly narrow time 
span — for example, over a three-month period. Many (or even all) of the members of a 
cohort of E&T enrollees may remain active in the program for far less than a year. More- 
over, individuals from outside the cohort may also enroll in the program during the 
same year. Thus, costs incurred by the cohort do not correspond to annual program 
costs. 

Even if all the program costs incurred by a cohort accrue over a relatively short 
period of time, however, the E&T program may still affect members of the cohort for 
many years after the program ends. For example, as a result of the program, the earnings 
received by a former participant may increase, and this increase may continue to be 
received as long as the participant remains in the work force. While these long-term 
effects must be taken into account in cost-benefit evaluations of ongoing E&T programs, 
they rarely need to be considered in pure cost analyses of these programs. 

2.3.1 Role of Discounting in Conducting Cost Analyses \ 

Viewed from the present, dollars that need not be paid until some future date do not 
impose as great a cost as the same amount of dollars that must be paid today because 
they can be used for some other purpose until they are paid. For example, they could be 
invested and earn interest. If E&T costs are projected and summed over several years, as 
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THE MECHANICS OF DISCOUNTING 



The procedure required for discounting is relatively simple. For each future year for which costs 
are estimated, the following formula can be used: 

PV(C y ) = C y /(l+d)y 

In this formula , y is a number that represents the future year for which costs are estimated (year 
1, year 2, year 3, and so forth), C y is the dollar value of the estimated costs for that year, PV(C v ) 
is the present value of C y , and d is the discount rate. The value of d is controversial among 
economists, but, in practice, values between .03 and .1 are typically used. A good approach is to 
select two or more values within this range and see whether the results of the cost analysis are 
very sensitive to using these alternative values. 




To illustrate discounting, assume that it is predicted that a not-yet-implemented E&T 
program will cost $1,500,000 in its first year of operation, $1,200,000 in its second year, and 
only $900,000 in its third year. Without discounting, total costs over the three-year period 
would be (inappropriately) predicted to be $3,600,000. Using a discount rate of .05, total costs 
would be predicted to be $3,294,461 and are computed as follows: 

$l,500,000/(l+.05)' + $1,200,000/(1 +.05) 2 + $900,000/(1 +.05)’ = $3,294,461 



they might be for budgeting purposes, it is necessary to adjust to account for the fact 
that current costs impose a greater burden than costs that occur in the future. This ad- 
justment is called discounting. The discounting procedure, in effect, allows one to deduct 
the interest that could be earned until the costs are incurred and must be paid. The 
resulting dollar figure is called the “present value” of the costs. When present values for 
different years have all been similarly adjusted, they can be appropriately summed. 

2.3.2 Adjusting for Inflation 

The purchasing power of a dollar erodes over time because of inflation. Conse- 
quently, if the data used in a cost analysis are several years old, it is helpful to those inter- 
preting the analysis if costs are stated in current dollars. This is especially important if 
changes in the costs of a program over time are being examined or if two or more pro- 
grams are being compared and the cost data for the different programs were collected 
during different years. 

Cost figures can be converted to current dollars by multiplying them by an adjust- 
ment factor obtained from the Consumer Price Index (CPI). Alternatively, the values 
used by the U.S. Department of Commerce to adjust estimates of the gross domestic 
product for inflation (the GDP deflator) can be used instead. It does not matter very 
much whether the CPI or the GDP deflator is used; they result in adjustments of similar 
magnitude. Up-to-date values for the CPI and the GDP deflator can be obtained from 
the Monthly Labor Review and the annually published Economic Report of the President, 
respectively. 
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THE MECHANICS OF THE INFLATION ADJUSTMENT 



The inflation adjustment factor is easily computed as follows: 

Adjustment Factor = I cy , 

where I cy is the value of either the CPI or the GDP deflator for the current year and I py is the 
corresponding value for the year for which the cost data are available. 




For example, if the cost data were two years old and the CPI equals 200 for that year and 220 for 
the current year, the two-year-old cost figures can be adjusted to current prices by multiplying 
them by 1.10 (or 220/200). Specifically, a two-year-old cost of $100 would be multiplied by 1.10 
in order to obtain a current dollar value that equals $110. 



2.3.3 Adjusting for Large Equipment Purchases 

Durable goods purchased by an organization, such as computer terminals and 
furniture, have a useful life of many years. The organization's expenditure on such 
equipment should not be assigned entirely to the year it is made, but should be spread 
over all its years of useful life. Straight-line depreciation is the easiest of the methods 
that can be used to do this. For a description of alternative methods, see Kumen H. 
Jones et al., Introduction to Financial Accounting: A User Perspective (Englewood Cliffs, 
NJ: Prentice-Hall, 1996, chapter 8). 



THE MECHANICS OF STRAIGHT-LINE DEPRECIATION 



Straight-line depreciation can be accomplished in three steps. First, the number of years the 
equipment to be depreciated will be used must be determined. Second, if the equipment will 
then be sold, its sales price (which is usually called its “salvage value”) must be predicted. Third, 
the annual cost of the equipment is determined by deducting its salvage value, if any, from its 
purchase price, and then dividing this total by the number of years it is expected that the equip- 
ment will be used. 




For example, if equipment that is purchased for an E&T program for $50,000 will be sold after 
five years for $10,000, then $8,000 (or [$50,000— $1 0,000]/5) would be an appropriate value to 
use for the equipment in determining the annual cost of the program. 



Chapter 3 



stimcj) Out Ongoing Programs 



The objective of this chapter is to provide the information you need to conduct a cost 
analysis of an ongoing employment and training program for the purpose of monitor- 
ing or evaluating this program. The methods described in this chapter can also be used 
in determining the costs of individual program activities (such as vocational training) 
and support services (such as child care). The chapter delineates the data needed to con- 
duct the analysis and describes the required steps. 

Cost analyses of ongoing E&T programs are described before cost analyses of not- 
yet-implemented programs are discussed because the data required for the former are 
available from the program itself. Cost analyses of not-yet-implemented programs, in 
contrast, require predictions; but, as discussed in chapter 5, these predictions can usually 
be based, in part, on information about the costs of similar ongoing programs. 

Moreover, as indicated in chapter 2, in determining the net cost of a not-yet-implement- 
ed program, the costs of the existing program should be subtracted from the predicted 
costs of the proposed program. Thus, it is helpful to understand how cost analyses of 
ongoing E&T programs are conducted before conducting analyses of not-yet-imple- 
mented programs. 

Readers who use the information from cost analyses but do not plan to conduct one 
of their own will be mainly interested in sections 3.1 and 3.2 and the text box found at 
the end of section 3.4. Section 3.1 discusses why costs are typically estimated on a per 
case basis, while section 3.2 describes the data needed for conducting a cost analysis. 

The text box at the end of this chapter provides a brief summary of the steps that should 
be followed in conducting cost analyses of ongoing programs. 
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3.1 Costs per Case Versus Aggregate Costs 

As mentioned in chapter 1, employment and training programs may be broadly divided 
into two categories: voluntary or mandatory. Voluntary E&T programs provide training 
for individuals who apply for them and meet certain criteria of need, such as being 
unemployed or having low incomes. Mandatory E&T programs require participation by 
recipients of government transfer payments who meet certain other criteria — for 
example, with respect to the length of time they have been on the transfer program rolls. 

The distinction between voluntary and mandatory E&T programs is rather formal 
in theory, but may blur in actual practice. Not every qualified person who applies to a 
voluntary program, for example, is necessarily accepted and, owing partially to imper- 
fect enforcement, not every person who meets the criteria for a mandatory program 
necessarily participates. Nonetheless, the distinction is important because cost analyses 
of the two types of programs differ in important respects. Cost analyses of ongoing vol- 
untary E&T programs usually compute the costs engendered by a typical individual 
who has been accepted into the program (costs per accepted case). Often, this is further 
limited to a typical accepted case that actually participates (that is, receives services) in 
the voluntary program (costs per participant).' Cost analyses of ongoing mandatory pro- 
grams, in contrast, generally calculate the costs generated by a typical transfer payment 
recipient who has been assigned or referred to the program (costs per referred case). For 
mandatory programs, unlike voluntary programs, cases that receive program services 
and those that do not must be included in computing average costs because both incur 
costs. Service recipients obviously engender costs; cases that do not receive services 
engender costs as a result of expenditures needed to enforce the programs participation 
requirement. 

As just indicated, program costs for both voluntary and mandatory E&T programs 
are typically computed on a per case basis, rather than being aggregated. However, there 
are situations in which it may be desirable to determine aggregate costs — for example, 
for budgeting purposes. The costs of ongoing programs are usually computed on a per 
case basis (be it case accepted or referred), rather than being aggregated, for several rea- 
sons. First, in comparing costs over time or among different programs, the total number 
of persons served by the program will drive aggregate costs. Thus, better comparisons 
can usually be obtained by looking at costs per case. Second, as discussed earlier, for 
many purposes, the costs of E&T programs should be compared with the benefits from 
these programs, such as increases in earnings and reductions in transfer payments. 
However, these benefits are almost always measured on a per case basis. Consequently, if 
program costs are to be compared with program benefits, they must also be computed 
on a per case basis. Third, information on the costs of ongoing E&T programs often 
serves as a key input in costing out programs that have not yet been implemented. As 



1. For simplicity, in the remainder of this guide, we refer only to costs per accepted case in discussing voluntary pro- 
grams. However, it is equally valid to estimate costs per participant for voluntary programs. This is not valid for 
mandatory programs because, as discussed in the text, those who receive services and those who do not both incur 
costs. 
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shown in chapter 5, use of this information is greatly facilitated if it is reported on a per 
case basis. Thus, this chapter focuses on the computation of program costs per case. 

In interpreting costs that are reported on a per case basis, it is important to keep in 
mind that they are an average of higher costs for some cases and lower, or even zero, 
costs for others. 



In the case of a voluntary program, for example, some unemployed persons may find 
jobs between the time they are accepted into the program and the time services actually 
become available, other cases drop out shortly after they begin to receive services. 
Similarly, in the case of a mandatory program, some individuals may leave the transfer 
program rolls (perhaps because they have found employment) between the time they 
are referred to the program and the time services are ready to begin. Moreover, other 
referred individuals may be excused from participation prior to the time when services 
become available (perhaps because of illness or because they find part-time employ- 
ment). Still others may refuse to comply with the requirements of the mandatory pro- 
gram, even if their transfer benefits are reduced as a result. Thus, costs-per-case esti- 
mates include small values for cases that incur small costs (for example, only costs 
resulting from a mandatory program enforcement process) and zero values for cases 
that incur zero costs. 



Data Needed for Cost Analyses of 
Ongoing E&T Programs 

Records Program Agencies Should Keep 

For administrative purposes, many agencies that are operating E&T programs 
already maintain all or most of the data needed for cost analyses of these programs, 
often in computer-retrievable form. The only items that must be added are those that 
provide information not already being collected. As indicated in later sections, because 
different agencies maintain data in different ways, procedures used to conduct a cost 
analysis of an E&T program operated by one agency will differ somewhat from proce- 
dures used to conduct an analysis of a similar program run by another agency. In other 
words, to some extent, the form of the data determines the nature of the analysis. 
Moreover, even within the same agency, efforts may have to be made to reconcile data 
sets that are maintained in different formats. 

To the extent time permits, it is important to attempt to ensure that tljie data collect- 
ed for the cost analysis are as accurate as possible. If there are errors in the data, they 
may need to be cleaned by first making detailed inquiries about individual data entries 
that seem inconsistent, implausible, or otherwise suspect, and then correcting these 
items. If this is not possible, other sorts of adjustments may be required. 
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The following data items are critical to cost analyses of ongoing E&T programs: 

■ time spent by program participants in each program component; 

9 allowances paid to program participants — for example, for day care or clothing; 

■ vendor payments made on behalf of program participants — for example, for day care; 

H subsidies paid to employers who hire program participants; 

■ stipends paid to those participating in the program; 

■ the salary and fringe benefits of each staff member involved in the operation of the E&T 
program being analyzed, even if many of these persons devote only part of their time to 
the program; 

■ special purchases (such as forms, computers, and furniture) made specifically for the 
program’s use; 

■ office overhead rates or, alternatively, the costs of the various items that go into overhead 
(for example, the rental value of office space, telephone bills, and equipment costs), even 
if these items are used for multiple purposes and, hence, are not exclusively devoted to 
the E&T program being analyzed. 




A $5 daily allowance was paid for attendance at job search workshops run as part of an 
E&T program for Aid to Families with Dependent Children (AFDC) applicants con- 
ducted during the 1980s. ; By comparing the number of persons who attended the work- 
shops with the number for whom allowances were recorded, the MDRC research team 
determined that there were allowance records for only about 5 percent of those who 
actually received allowances. To adjust for this discrepancy, MDRC inflated the recorded 
allowance amounts. 



3.2.2 Data Needed from Outside the Program Agency 

The agency with direct responsibility for an E&T program may not perform many 
of the services participants in the program receive. A welfare agency may operate an 
E&T program for public assistance recipients, for instance, but much of the actual train- 
ing may be conducted by local community colleges. Depending on contractual arrange- 
ments, the welfare agency may or may not make tuition payments to the community 
colleges. However, even when such payments are made, they may not accurately reflect 
the full cost incurred by the colleges. The colleges may depend on revenue collected 
from property taxes, as well as tuition, but the welfare agency may be required to pay no 
more than the standard tuition amount. Other payments to outside organizations — for 
example, those made to day care providers — may, in contrast, reflect the full costs of 
providing a service. In the latter case, the cost analysis can rely entirety on the program 
agency’s records, but in the former case, information must be obtained directly from the 
service provider. 



2. Barbara Goldman, Daniel Friedlander, and David Long, Final Report on the San Diego job Search and Work 
Experience Demonstration (New York: MDRC, 1986). 




Chapter 3: Costing Out Ongoing Programs 



21 



Cost information provided by organizations other than the program agency are 
unlikely to be as detailed as the agency’s own records since the agency has no control 

over external records. However, in most instances, the information provided by external 
sources is sufficient. 



3.3 Steps in Estimating the Gross Costs 
of Ongoing Programs 

This section lists the seven steps required to determine the gross costs of ongoing pro- 
grams, discusses why each step is needed, and describes approaches that can be used to 

complete each step. Section 3.4 then describes how net costs can be obtained, once gross 
costs are estimated. 



^ A spreadsheet that is based on the seven steps is available on the accompanying 

A word of caution: The seven steps described in this section can be used to estimate 
the gross costs of virtually any ongoing program. The procedures for completing each 
step, however, depend on the data and time available to the analyst. Specific program 
circumstances may require the analysis to vary in detail from some of the suggestions in 
this section, and approximations and compromises may be necessary. Those who are 
extremely time-constrained might want to consider using some of the values for other 
E&T programs that are provided in Appendices B-F (although, as discussed in chapter 
5, these values are really more appropriately used in costing out a not-yet-implemented 
E&T program). It is important to be aware of the errors that may result from any neces- 
sary approximations and compromises, and to ensure that users of the cost analysis are 
apprised of potential errors. 

Stepl. Enumerate Program Components 

Each of the activities and support services provided by the E&T program undergoing a 
cost analysis needs to be listed. Program activity categories might include orientation, 
assessment, job search, basic education, vocational training, work experience, and so 
forth. Support service categories could include child care, transportation, and 
allowances paid to program participants. 

The exact categories will, of course, be determined by the nature of the program 
itself. The categories should be sufficiently inclusive so that each cost engendered by the 
program falls under some category. To help ensure that program costs do hot get over- 
looked, it may be helpful to develop a detailed flow diagram of the sequence of E&T 
activities. (Examples of such a diagram appear in the following chapter in Figures 4. 1 
and 4.2.) In general, it is better to use more detailed, rather than less detailed, categories, 
since categories can always be combined later. Information about the costs attributable 
to a narrowly defined program activity or support service is useful, for example, in 

ERLC 3 3 
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forming judgments as to whether expenditures on the component are too high or too 
low. Realistically, however, each category must be defined so that data on unit cost, par- 
ticipation rates, and length of participation that correspond to the category are obtain- 
able. Hence, the category definitions will be at least partially determined by the data 
available for the cost analysis. Moreover, the number of categories should not be so large 
that they are unwieldy or confusing to work with. 

Step 2. Compute Unit Costs 

Unit costs are simply the costs of providing a particular program component to one per- 
son over a specified time period. The appropriate time period to use in computing unit 
costs will vary with the component being examined. For example, the unit cost of pro- 
gram orientation is usually most readily computed as the cost of providing one session 
to one person, while the unit cost of job search, work experience, transportation 
allowances, or child care could be computed as the cost of providing these activities and 
support services for either a week or a month. If the cost of providing a particular pro- 
gram component is shared by two organizations — as when, for example, the E&T 
sponsoring agency and a community college divide the cost of providing vocational 
training — it is usually both easier and more useful to compute the unit cost incurred 
by each organization separately. 

a. The Basic Computation. Unit costs can be determined by first calculating the 
total cost of providing a given program component over a specific time period (for 
example, a session, a school semester, a week, a month, or a year) and then dividing by 
the number of individuals who participated in the activity or received the service over 
the corresponding time period. Thus, data are needed on both total cost and number of 
participants during the time period. (As discussed in chapter 2, start-up costs should 
usually be excluded from estimates of the costs of ongoing programs. Thus, the time 
period used for computing costs should ideally be a “steady state” period for the pro- 
gram — that is, a period of relative stability.) 




Assume that an ongoing E&T program spent $100,000 on job search during a one-year 
steady-state period and that, during this period, an average of 100 persons participated 
in job search each month. Then, the unit cost for job search equals 



$100,000 annual costs/( 100 participants x 12 months) 
= $83.33 per participant per month. 



It is important to note that in calculating unit costs in this manrter, any case man- 
agement costs that are part of the activity will be included in the measure of unit costs. 
One example is the cost of enforcing the participation requirement in a mandatory 
program. Moreover, all the costs of a program are ascribed to those individuals who 
actually participate in the activity. This could be important if some persons who are 
assigned to the activity fail to show up, as these “no shows” may nonetheless engender 
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costs as a result of staff time required to process paperwork and encourage them to 
attend. These costs will be included in the numerator of the unit cost measure, but not 
in the denominator. 



If, in the illustration appearing above, $95,000 of the $100,000 expended on job search 
was incurred by the 100 job search participants, and the other $5,000 was engendered by 
20 no-shows, the entire $100,000 would be ascribed to the 100 participants — because it 
took $100,000 to produce 100 participants. Moreover, as the remaining calculations are 
all based on persons who participate in each program activity, costs engendered by no- 
shows would be inappropriately left out of the final cost estimates if costs incurred by 
no-shows, as well as those engendered by job search participants, were not included in 
the numerator of the unit cost ratio. 

b. Determining Staff Time. If each E&T program staff person served program 
participants exclusively and engaged in only one activity (for example, instruction, case 
management, counseling, or administering voucher payments) and resources such as 
rental space and computers were similarly exclusively dedicated, computing unit costs 
would be greatly simplified. In practice, however, each staff member often serves both 
persons in the program being analyzed and persons outside the program, and engages 
in a variety of activities (such as orientation sessions, counseling, and individual job- 
search monitoring). Physical resources may similarly serve a multiplicity of functions. 

For the purpose of cost analysis, it is critical to determine the proportion of total 
staff time and personnel costs devoted to the E&T program being analyzed. The cost of 
physical resources must be similarly allocated between program and nonprogram uses. 

In addition, allocations must be made among the various program components so that 
costs can be appropriately assigned to the various program component categories listed 
under step 1. 

There are at least three different ways to allocate staff time among different activities: 
time studies, time sheets, and interviews. Many government agencies routinely engage in 
time studies in which selected staff members are monitored by others to determine how 
their time during a workday is allocated. Findings from these studies can be readily 
adopted for use in an E&T cost analysis if the time studies collect information in a man- 
ner consistent with the needs of the cost analysis. For instance, if there is a desire to dif- 
ferentiate between time spent in helping prepare a client for a job interview and time 
spent in counseling a client on resolving internal family problems, then the instrument 
used in the time study may have to be modified to distinguish between these two activi- 
ties. Furthermore, if the information is not otherwise available, it may be necessary to 
record the number of persons who receive each type of counseling. If possible, it is also 
often useful to differentiate between time spent in performing a task for program partici- 
pants and time spent performing the same task for persons outside the program. 

Time sheets are similar to time studies, except that staff members themselves are 
responsible for keeping track of the time they spend on different tasks. The time sheets 
are usually filled out over a period of several weeks. Data on the number of persons who 
participate in each program activity during these weeks could also be recorded on the 
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time sheets if not available elsewhere. Once again, the instrument used must be consis- 
tent with the requirements of the cost analysis. It may be desirable, for example, to sepa- 
rate staff time spent in case management from time spent in other ways; this can be 
accomplished by using a carefully designed time sheet. For illustrative purposes, the 
time sheet used by MDRC in its recent cost analysis of two welfare-to-work programs in 
Minnesota — the Minnesota Family Investment Program (MFIP) and STRIDE, the 
states version of the federal-state Job Opportunities and Basic Skills Training (JOBS) 
program — is shown in Table 3.1. 

In interviews, staff members (or their supervisors) are asked about the amount of 
time they typically devote to each activity of interest. This approach is, in general, inferi- 
or to the use of time studies or time sheets because it relies on the staff’s ability to recall 
their time allocations retrospectively. This is likely to result in errors, especially when rel- 
atively small amounts of time are devoted to a particular activity. Thus, if possible, the 
use of interviews should be limited to supplementing information obtained from time 
studies or time sheets. 

Once staff time is allocated among activities, further steps may be necessary to allo- 
cate time devoted to performing a particular activity between persons in the E&T pro- 
gram that is being analyzed and persons outside the program. This is obviously unnec- 
essary if the task is performed exclusively for those in the program or if staff performing 
the task can differentiate between the time they devote to each group. This is not always 
feasible, however; counselors may not even know whether a particular client is in the 
E&T program. In such circumstances, time can often be allocated on the basis of the 
number of persons in each group — assuming that, on average, the time spent perform- 
ing the task for a program participant is roughly the same as the time spent performing 
the task for a nonparticipant. This assumption may not, of course, be valid. 

c. Treatment of Overhead. Once the fraction of time each staff member devoted to 
various activities is known, this information can readily be converted to dollar figures by 
multiplying the fractions by the staff members’ salaries over an appropriate time period, 
such as one year. After doing this, it is important to distinguish between the costs that 
are included in the resulting estimates and the costs that are left out. 



Specifically, the estimates clearly include the program costs that accrue to line staff who 
are directly involved in various E&T activities. However, costs associated with support 
staff, such as secretaries, and supervisors may be left out of the estimates. In addition, 
fringe benefits may or may not have been included in the salary figures used to obtain 
the estimates. Finally, the costs of various physical resources, such as computer systems, 
furniture, physical facilities, and telephones, will definitely be left out of the estimates. 

For the purpose of this discussion, costs that are included in the Estimates are 
referred to as personnel costs and costs that are left out are referred to as overhead costs . 

The estimates of personnel costs can be used in assigning overhead costs to various 
E&T activities. This is usually done in one of two ways. The first method is to multiply 
an organization’s overhead rate — that is, the organization’s total annual expenditures 
divided by its total annual expenditures on staff salaries — by the estimate of the staff 
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personnel costs for each activity. In making this calculation, the salary values used to 
compute the denominator of the overhead ratio must include only the salaries on which 
the estimates of personnel costs were based. The numerator, however, should include the 
costs of all the personnel and physical resources that are either directly or indirectly 
involved in running the E&T program. The costs of personnel and resources that have 
nothing to do with the program should be excluded from the numerator, however. As 
the numerator of this rate will include both personnel costs and overhead costs, while 
the denominator will include only the former, the rate itself will exceed one. 



1 




An overhead rate of 2.5 would imply that the total costs of the program are two and a 
half times larger than the personnel costs. Thus, multiplying the estimate of personnel 
costs of an activity by the overhead rate results in inflating or marking up the estimate 
so that it includes both the personnel costs and the overhead costs associated with the 
activity. If personnel costs were, say, $50,000, and the overhead rate was 2.5, total costs 
(personnel costs plus overhead costs) would equal 2.5 x $50,000, or $125,000. 



The second approach is to multiply total annual expenditures on each overhead 
item (secretaries’ salaries, supervisors’ salaries, computers, rental space, telephone, and 
so forth) by the fraction of the organization’s total staff costs devoted to each activity. 






Say that 5 percent of the total staff costs of an organization that was operating an E&T 
program was required to pay staff for aiding program participants in their search for a 
job and that the organization’s rental expenditures were $100,000 a year. Given this 
hypothetical situation, $5,000 (or .05 x $100,000) of rental expenditures would be 
assigned to the job search component of the program. 



In using either of the approaches just described, it is important to recognize that 
durable equipment purchased by an organization, such as computer terminals and fur- 
niture, have a useful life of many years. As discussed in chapter 2, a depreciation method 
should be used to spread the organization’s expenditures on such equipment over the 
equipment’s years of useful life. 



Step 3. Select the Analysis Sample 

Steps 4 and 5 in the cost analysis of ongoing E&T programs require estimating measures 
of participation for individuals accepted into voluntary programs or referred to manda- 
tory programs. But it is often unnecessary to obtain the data needed to make such an 
estimate for every individual who has ever been accepted into or referred to the program 
being analyzed. A subgroup, if sufficiently large, will often suffice. If a subgroup of indi- 
viduals is used for the cost analysis, however, it is important that this subgroup be repre- 
sentative of all those who are accepted or referred. 
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(®3) The analysis sample might consist of a cohort of individuals who were accepted or 

referred over a given time interval, ideally a period during which the program was in a 
steady state. If this cohort is sufficiently large, then a subsample of members of the 
cohort could be randomly selected. If only those with social security numbers ending in 
3 or 7 were selected, for instance, 20 percent (two numbers out of a possible ten) of the 
cohort would be randomly selected. 

Step 4. Determine Participation Rates 

After the sample to be used in the cost analysis has been selected, the fraction of the 
sample that participated in each of the activities and received each of the support ser- 
vices listed in step 1 must be determined. In completing this step, it is often useful to 
first define the minimum level of activity required before an individual will be counted 
as participating in a particular program component — for example, receipt of at least 
one day of vocational training or reimbursement for at least one week of child care. 

Three sources of data can be used to determine participation rates: (1) a computer- 
ized management information system that tracks the E&T activities in which individual 
members of the analysis sample participated and the support services they received, 

(2) a review of the individual hard-copy case files of members of the analysis sample, 
and (3) surveys administered either in person or by telephone to each member of the 
analysis sample. A computerized tracking system that contains complete, accurate, and 
clean data provides an ideal means of computing participation rates. If such a system is 
not available, however, then the other two data sources must be used instead. Unfortu- 
nately, surveys are subject to recall error, while case files are laborious to use and may 
contain incomplete information. However, using surveys and case files to verify and 
supplement one another can increase accuracy. Moreover, if the computerized tracking 
system exists but contains incomplete or inaccurate information, its reliability can be 
checked and improved by using data from the other two sources. 



NONPROGRAM COSTS 



Some E&T participants may enroll in various training and education activities — for example, 
a computer training course or college — even after they have formally completed the E&T 
program, perhaps stimulated by their experiences in the program. Such activities, which are 
sometimes called nonprogram activities, are outside the scope of the E&T program. Yet, they 
obviously engender costs, even though the program agency will bear little or none of these 
costs. For most purposes, these nonprogram costs can be ignored. However, in conducting a 
very comprehensive cost analysis, perhaps as part of a cost-benefit analysis, they should be 
estimated. To do this, it is quite likely that surveys will have to be used to determine participa- 
tion rates in nonprogram activities, as the necessary information is unlikely to be available in 
either computerized management information systems that are operated by the program or in 
program case files. Because program agencies will, of course, be more interested in program 
costs than nonprogram costs, the two types of costs should be recorded separately. 
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Step 5. Determine the Average Length of Participation 

For each member of the analysis sample who participated in a given E&T activity or 
received a given support service, the duration of participation or receipt must be deter- 
mined. Averages can then be computed for each program component. The time period 
that is used to compute the length of participation must be consistent with the unit cost 
measure. 




If the unit cost of vocational training is measured as the cost of providing vocational 
training for one month to one person, then length of participation must be measured 
as the number of months that a typical vocational training participant received such 
training. 



The data sources that can potentially be used to determine average lengths of par- 
ticipation are the same as those that can be used to determine participation rates: com- 
puterized tracking systems, case files, and surveys. Again, data from each of these 
sources can be used to check the reliability and make adjustments in data from the other 
sources. It should be noted that survey data on length of participation in a given pro- 
gram activity are almost surely subject to greater recall error than survey data on 
whether individuals participated in the activity at all. 



Step 6. Compute Gross Cost per Case for Each Program Component 

Step 6 is mechanical in nature once steps 1-5 have been completed. The cost of 
each program component for a typical person who has been accepted into or referred to 
the program is determined by first multiplying the unit cost of the activity or support 
service (as determined by step 2) by the average length of participation in the compo- 
nent (as determined by step 5). The product is then multiplied by the component’s par- 
ticipation rate (as determined by step 4). Thus, costs for the component are averaged 
over both participants and nonparticipants in the component, even if the costs incurred 
by the latter group are zero. 




Suppose it costs $130 to provide one month of vocational training to one person and 
that those persons who received such training remained in it for an average of six 
months. Then, the cost of vocational training would be $780 (or 6 x $130) for each per- 
son who received it. However, if only 10 percent of the analysis sample actually partici- 
pated in vocational training, the cost per case for this program component would be 
only $78 ( or .10 x $780). 



Step 7. Compute Total Gross Cost per Case 

This step is also mechanical. An E&T program’s total gross cost per accepted or referred 
case is computed by simply summing all the cost-per-case values obtained in step 6. 
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It is important to recognize that the cost-per-case values for the various program 
components can be appropriately added together only because they are all computed by 
averaging across the same group of individuals. Specifically, all the members of the analy- 
sis sample are included in the averages, regardless of whether those individuals actually 
participated in particular program components or not. Averages that are instead comput- 
ed for groups that differ in composition and size cannot be appropriately summed. 



All 1,000 members of an E&T program analysis sample participate in an orientation ses- 
sion at a cost of $10 per person, while one member of the sample receives a four-year 
college education at a cost of $50,000. Total program cost per case is obviously not 
$50,010 [or $10 + $50,000] but is instead only $60 [or $10 + ($50,000/1 ,000) ] . In other 
words, the average costs of the two program components cannot be summed unless they 
are computed over the same group of individuals. 



Converting Gross Costs into Net Costs 

Chapter 2 suggested that for certain purposes, such as cost-benefit evaluations of ongo- 
ing E&T programs and assessing what it cost to replace a previous E&T program with 
the current program, the costs of ongoing programs are more usefully measured in net, 
rather than gross, terms. Gross costs remain relevant, however, because measuring the 
net costs of an ongoing E&T program requires that its gross costs be measured first. 

Except in the case of a formal cost-benefit evaluation, net costs can, at least in prin- 
ciple, be fairly readily determined if estimates are available of the gross cost per case of 
both the ongoing program and the program it replaced (assuming there was one). As 
mentioned in chapter 2, both estimates should ideally be obtained after the programs 
reach a steady-state level of operation so that they exclude start-up costs. Given such 
estimates, computing net costs would involve the following four steps. (If there was no 
previous program, then the first three of these steps can be ignored.) 

!• If the cost-per-case estimates for the two programs pertain to two different years, then 
the estimate for the older program should be adjusted for inflation using the method 
described in chapter 2 (section 2.3.2). 

2. Costs per case should be transformed to aggregate annual costs for both estimates by 

multiplying costs per case by the number of cases accepted or assigned during the year 
for which each estimate was obtained (see the box below). This step will account for the 
possibility that the number of cases in the old program and the current program may 
have differed. •; 

3. The aggregate annual cost of the old program should be subtracted from the aggregate 
annual cost of the current program. 

4. As discussed in chapter 2, the cost of any equipment that was not used in the old pro- 
gram, but is used in the current program and would not otherwise be used for some 
non-E&T purpose, should be subtracted from the estimate obtained in step 3, above. 

? 1 
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Notice that in the four steps above, the net cost estimates rely on comparing indi- 
viduals who are accepted into or assigned to two different programs. These two groups 
of individuals may, of course, differ in a number of respects — demographic composi- 
tion, education level, work experience, motivation, and so forth — and these difference 
may, in turn, create cost differences between the two programs. For most purposes, this 
is quite appropriate. After all, if a decision is made to replace one program with another, 
the costs resulting from that decision are accurately reflected by the difference in the 
costs of the two programs regardless of the causes of these differences. 




!' 
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THE TRANSFORMATION FROM COSTS PER CASE TO AGGREGATE ANNUAL COSTS 



Costs per case can be used to calculate aggregate annual costs for ongoing programs by 
multiplying costs per case by the number of cases newly accepted (in the case of a voluntary 
program) or newly assigned (in the case of a mandatory program) during a year. Cases that 
are already in the program at the beginning of the year incurred costs during both that year 
and the previous one. Although the costs they incurred during the current year are omitted 
from the calculation, this is roughly offset by the fact that some of the costs incurred by the 
newly accepted or assigned cases will not be incurred until the following year. For purposes of 
computing annual aggregate cost, the estimate of the average length of participation (step 5) 
may have to be scaled back for those program components in which individuals often 
participate for longer than 12 months, such as college or child care. To do this, no values for 
individual cases should be permitted to exceed 12 months in determining the average length 
of participation. 



In cost-benefit evaluations, in contrast, net costs are usually estimated by comparing 
costs engendered under two program regimes by two groups of individuals who are as 
similar as possible. Persons assigned to or accepted by the program being evaluated are 
usually referred to as the “program group,” while those under an alternative program 
regime are usually called the “comparison group” The reason for comparing two similar 
groups is that the effects of the program being evaluated on such outcomes as earnings 
and welfare payments would ideally be determined by comparing the earnings and wel- 
fare payments of the same group of individuals under both program regimes. Because 
individuals cannot be under two program regimes at the same time, this is obviously 
impossible. Consequently, an approximation is obtained by comparing the earnings and 
welfare payments of the program group with the earnings and welfare payments of a 
similar comparison group. To maintain comparability, exactly the same approach is used 
to determine net costs in a cost-benefit evaluation. 

Because members of a comparison group do not have access to tHe services provid- 
ed by the E&T program, they are likely to obtain those services from a wide variety of 
other sources, and comprehensive data on such nonprogram E&T services are essential. 
Moreover, these data must be similar to those for members of the program group so that 
appropriate comparisons can be made. In addition, the funding sources of E&T services 
received by members of the comparison group must be carefully tracked because the 
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agencies and organizations that provide these services may differ from those operating 
the E&T program being analyzed. 

Obtaining an appropriate comparison group for a cost-benefit analysis, measuring 
the E&T costs incurred by this group, and then comparing these costs with those 
incurred by the program group involves numerous technical issues that are well beyond 
the intended scope of this guide. Thus, the discussion here is limited to brief comments 
on a few general points. (There is an extensive professional literature that focuses on 
these and related topics. Agencies that wish to conduct a cost-benefit evaluation of an 
E&T program should obtain help from experts with experience in using comparison 
groups to conduct such analyses.) 

Obtaining Comparison Groups for Cost-Benefit Analyses 

In many situations, some of the persons who would otherwise be accepted into or 
referred to an E&T program are instead randomly assigned to a “control” group. While 
ineligible to take part in the E&T program, members of the comparison group can 
receive whatever employment and training services are otherwise available to them. The 
major advantage of this “random assignment” strategy is that — when research samples 
are large — persons in the comparison group will, on average, be very similar to persons 
in the program group in terms of education, employment history, motivation, and so 
forth, differing only by chance. Thus, E&T costs incurred by members of the program 
group and members of this comparison group can legitimately be compared. 

Sometimes, however, random assignment is not appropriate or feasible. For exam- 
ple, agencies running E&T programs may be reluctant to follow the random assignment 
strategy because they do not want to deny services to some persons who would other- 
wise qualify, or they may simply find it inconvenient administratively to treat otherwise 
similar persons differently. Further, there may be programs for which the supply of pro- 
gram “slots” and potential applicants are approximately equal, and diverting some peo- 
ple to a comparison group would lead to a reduction in services. Finally, in some pro- 
grams the goal may be to completely “saturate” a community or group of families with 
services, so random assignment would undercut the program model. 

In such instances, a number of possible alternative strategies are available for 
obtaining comparison groups. We mention only two here. (For a more comprehensive 
discussion, see Daniel Friedlander, David H. Greenberg, and Philip K. Robins, 
“Evaluating Government Training Programs for the Economically Disadvantaged,” 
Journal of Economic Literature , December 1997, pp. 1809-1855.) In the first, the costs 
incurred by persons accepted into or referred to the E&T program being analyzed are 
compared with E&T costs incurred by similar persons prior to the introduction of the 
program. The second possibility is to compare E&T costs at locations where the pro- 
gram operates with E&T costs at locations where it does not. ' 

One problem with nonrandom assignment approaches such as these two is that the 
environmental circumstances — economic conditions, for example — facing the pro- 
gram and comparison groups may differ in important respects. These differences could 
affect participation rates and length of stay in E&T programs, which would, in turn, 
affect E&T costs. A second problem is that the personal characteristics of the two groups 
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being compared may differ in important respects, and these differences may affect the 
amount of E&T services they receive and, hence, the E&T costs they incur. Some of 
these differences (for example, demographic differences) can frequently be controlled 
for through various statistical procedures, but others (differences in motivation) often 
cannot. 

A word of warning: the comparison group should never be limited to only those 
persons who actually receive E&T services. Instead, the comparison group should 
include persons who are as similar as possible to those accepted into or referred to the 
program of interest, regardless of whether or not they receive E&T services. Limiting the 
comparison group to only those who actually receive services ignores possible differ- 
ences in program participation rates that cause E&T costs to differ. 



A SUMMARY OF THE STEPS FOR ESTIMATING THE GROSS COSTS 
OF AN ONGOING PROGRAM 



Step 1. Enumerate program components. List all the components of the E&T program — that is, all 
the program activities and support services. 

Step 2. Compute unit costs. Compute the average cost of providing one unit (for example, an hour or 
a month) of each of the program activities and services listed in step 1 to one person. 

Step 3. Select the analysis sample. Select a representative group of cases that have been accepted into 
or referred to the E&T program. Program costs will be estimated for these cases. 

Step 4. Determine participation rates. Estimate the fraction of the cases selected in step 3 that 

participated in each of the program activities and received each of the support services listed 
under step 1. 

Step 5. Determine the average length of participation. Estimate the average length of time over 

which those cases that participated in each program activity remained active and those cases 
that received each support service continued to obtain the service. 

Step 6. Compute gross cost per case for each program component. Compute the cost per case for 
each program component as follows: 

unit cost (step 2) x participation rate (step 4) 
x average length of participation (step 5) 

Step 7. Compute.total gross cost per case. Compute the total gross cost per case for the E&T program 
by summing all the cost-per-case values obtained in step 6. 



Chapter 4 




This chapter identifies the key factors that cause cost estimates to vary and presents 
detailed findings from an actual cost analysis — specifically, MDRC s cost analysis of 
JOBS programs in three different communities. The tables from the MDRC analysis pro- 
vide examples of how information from your own cost analysis can usefully be present- 
ed. The material in section 4.2 demonstrates how the steps described in chapter 3 can be 
used to determine the cost of an actual ongoing E&T program. Our intent is to clarify 
how these steps can be applied in practice. Finally, the factors that caused costs to vary 
among the JOBS programs in the three communities are examined in some detail, with a 
focus on one community, Riverside, California. These factors are important because cost 
estimates from ongoing E&T programs provide a major source of information that can 
be used for costing out not-yet-implemented programs. The factors that cause costs to 
vary from one program to another, however, must be taken into account if information 
from ongoing programs is to be most appropriately used for this purpose. 

Readers who use the presented estimates to conduct cost analysis of a not-yet- 
implemented program will find the cost figures presented in this chapter useful for con- 
ducting sensitivity analysis of the sort described in chapters 5 and 6. 

Readers who are interested in a cost analysis of ongoing programs will find Table 4.8 
of particular interest as it illustrates how the steps developed in chapter 3 can be readily 
used in a spreadsheet. Table 4.8 can be replicated using the file on_going on the disk. 



